A Windows-Based Parallel File System
نویسندگان
چکیده
Parallel file systems are widely used in clusters to provide high performance I/O. However, most of the existing parallel file systems are based on UNIX-like operating systems. We use the Microsoft .NET framework to implement a parallel file system for Windows. We also implement a file system driver to support existing applications written with Win32 APIs. In addition, a preliminary MPI-IO library is also developed. Applications using MPI-IO could achieve the best performance using our parallel file system, while the existing binaries could benefit from the system driver without any modifications. In this paper, the design and implementation of our system are described. File system performance using our preliminary MPI-IO library and system driver is also evaluated. The results show that the performance is scalable and limited by the network bandwidth.
منابع مشابه
DotDFS: A Grid-based high-throughput file transfer system
DotGrid platform is a Grid infrastructure integrated with a set of open and standard protocols recently implemented on the top of Microsoft .NET in Windows and MONO .NET in UNIX/Linux. DotGrid infrastructure along with its proposed protocols provides a right and solid approach to targeting other platforms, e.g., the native C/C++ runtime. In this paper, we propose a new file transfer protocol ca...
متن کاملThe Computational NeighbourhoodTM: A User Centric Approach to High-Performance Cluster Computing
File and printer sharing have been popularized with Microsoft’s Windows Network Neighbourhood and the Unix Network File System (NFS). Cluster computing has become an attractive choice for high-performance computing as workstation and network technology continue to become faster and less expensive. Although computer networks can easily be organized into a computing cluster, there is still a need...
متن کاملComparing Windows NT, Linux, and QNX as the basis for cluster systems
Clusters use commodity hardware and software components to provide an environment for highperformance parallel processing. A major issue in the development of a cluster system is the choice of the operating system that will run on each node. We compare three alternatives: Windows NT, Linux, and QNX—a real-time microkernel. The comparison is based on expressive power, performance, and ease-ofuse...
متن کاملRAP - Resource Adaptive Programming with an application to robust and fast file copying
Network file copy programs are prime examples of system applications that use various resources: CPU, disk and network. The resources used in a local-area network, where network throughput can be higher than disk throughput, are incompatible with resources used when copying files over a highlatency, low-bandwidth remote network. A customary solution to scaling network applications is by using a...
متن کاملHandbook on Parallel and Distributed Processing
Reading is a hobby to open the knowledge windows. Besides, it can provide the inspiration and spirit to face this life. By this way, concomitant with the technology development, many companies serve the e-book or book in soft file. The system of this book of course will be much easier. No worry to forget bringing the handbook on parallel and distributed processing book. You can open the device ...
متن کامل